Forum for Electromagnetic Research Methods and Application Technologies (FERMAT) 


Determinism in Electromagnetic Design & 
Optimization - Part II: 
BBP-Derived z fractions for Generating 
Uniformly Distributed Sampling Points in 
Global Search and Optimization Algorithms 


Richard A. Formato 


Consulting Engineer & Registered Patent Attorney 
Of Counsel, Emeritus 
Cataldo & Fisher, LLC 
PO Box 1714, Harwich, MA 02645 USA 
(Email: rf2 @ieee.org) 


Abstract—Design and optimization problems in applied 
electromagnetics, in particular antenna D&O, often rely on 
global search and optimization metaheuristics based on 
Nature-inspired metaphors. Because the algorithms are 
inherently stochastic each run produces different results. 
These uncertain outcomes can be mitigated by pseudo 
randomly sampling the decision space. This article 
describes x fractions as a method to create deterministic 
uniformly distributed decision space sample points. These 
fractions appear to be uniformly distributed on [0,1) and 
can be used in any stochastic algorithm rendering it 
effectively deterministic without compromising its ability 
to explore the decision space. 7 fractions are generated 
using the BBP z digit extraction algorithm. This approach 
is tested using genetic algorithm xGASR with good results. 


Index Terms—Applied Electromagnetics, Antenna, x 
fraction, BBP Algorithm, Optimization, Global Search, 
Decision Space, Pseudo random, Low  Discrepancy 
Sequence, van der Corput, Halton. 


I. INTRODUCTION 


Uniformity in randomly generated sample points is an 
important consideration in global search and optimization. 
Sample points should be generated using a truly uniformly 
distributed random variable calculated from a probability 
distribution, but most pseudo random sequence generators fall 
short because their points in fact are not uniformly distributed. 
One alternative approach is using Low Discrepancy Sequences 
(LDS) in which there appears to be growing interest. De 
Rainville et al. [1,2] provide a summary of the uniformity 
problem and develop an evolutionary optimization approach to 
generating LDS. Pant et al. [3] describe an improved Particle 


Swarm Optimization (PSO) algorithm utilizing van der Corput 
and Sobol LDS. Other representative, not exhaustive 
examples include LDS applied to liquid crystal display dot 
patterns [4], power system stabilizers [5], and financial 
analysis [6,7]. 


This note describes an alternative approach to generating 
uniformly distributed sample points using 7 fractions 
computed from hexadecimal digit extraction from the constant 
m. x fractions [8] are uniformly distributed and provide a basis 
for creating reproducible sample point distributions that can be 
used in any global search and optimization algorithm 
regardless of its nature, stochastic, deterministic or hybrid. 


A companion paper, Part I [16], discusses how deterministic 
algorithms such as Central Force Optimization (CFO) can be 
very useful in the solving real-world problems that do not 
have a priori suitable fitness functions or that require 
computation-intensive external "modeling engines." Determ- 
inistic metaheuristics often have difficulty effectively 
exploring the decision space (DS) while stochastic algorithms 
generally are more effective in that regard. a fractions may 
eliminate this dilemma by giving the algorithm designer the 
option of adding pseudo randomness to an otherwise 
deterministic algorithm like CFO or of adding determinism to 
an otherwise stochastic algorithm like Ant Colony 
Optimization. Because the x fractions are uncorrelated with 
the fitness function's landscape, but known with absolute 
precision, they hold the promise of improved exploration 
while retaining complete determinism. 


Yet another reason for considering n fractions is what some, 
including the author, consider a willy-nilly proliferation of 
stochastic metaheuristics of questionable merit [11]. 
Examples range from "Anarchic societies" to "Zombies" [12]. 
How can these algorithms be efficiently compared head-to- 
head? Making them deterministic would be a good first step. 
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This paper is organized as follows: Section II describes the 
Bailey-Borwein-Plouffe extraction algorithm used to generate 
the a fractions. Section III discusses the dimensional 
correlations that show up in LDS sequences and under certain 
circumstances in z fractions resulting in highly non-uniform 
sample point distributions. Section IV describes the tGASR 
algorithm used to test the efficacy of x fraction sample point 
distributions. Section V presents benchmark testing results, 
and Section VI is the Conclusion. 


Il. BBP ALGORITHM 


The Bailey-Borwein-Plouffe (BBP) algorithm quite 
remarkably extracts hexadecimal digits from the numerical 
constant x beginning at any digit without having to compute 
any of the preceding digits. BBP is based on the identity 


Satie! | 4 2 1 1 | 
16° (8k+1 8k+4 8К+5 8k+6 
whose derivation and use in BBP are described in detail in [8]. 
As an example, the hex digits of 1 starting at digit 1,000,000 
are 26C65E52CB459350050E4BB1 and the corresponding a 
fraction is 0.151464362347971272412488292131. For all 
practical purposes the first 215,830 a fractions are uniformly 
distributed on [0,1) with a mean value of 0.499283729688375. 
The Cumulative Distribution Function (CDF) for these data is 
plotted in Fig. 1 (1,000 bins) in which Pr[ zz, € X J is the 


probability that a fraction æ, is less than or equal to 


0x X <1. Itis reasonable to speculate that all sequential 77, 


are uniformly distributed. Testing on various subsets of this 
data set reveals a uniform distribution regardless of how many 
contiguous fractions are included in any fairly large sample or 
where the sequence is begun. It also seems reasonable to 


believe that any sufficiently large set of arbitrarily selected 7, 


also will be uniformly distributed in [0,1). These 
characteristics have not been investigated for the other 
constants discussed in [8], so it is not known whether or not 
they exhibit similar behavior. 


HI. DIMENSIONAL CORRELATIONS 


Nonuniformity in LDS sequences often is evident in 
bidimensional plots in high dimensionality spaces. Figs. 2 and 
3 in [1] are good examples. They show, respectively, almost 
perfect linear correlations in monotonically increasing van der 
Corput sequences [13] and correlations between dimensions 7 
and 8 in a Halton sequence [14]. Other striking visual 
examples appear in [6] and [7]. Testing of van der Corput and 
Halton sequences reveals many undesirable correlations. A 
typical 30-dimensional Halton example for coordinates 27 and 
28 appears Fig. 2. 

Sample points based on z fractions also can exhibit strong 
linear correlations, but apparently only under very limited 
circumstances. For example, Fig. 3 plots (%27,x2s) for 1,000 
points in 30 dimensions using the z fractions in their order of 
occurrence (index increment = | starting with the first a 
fraction ). The linear correlation is obvious, but it disappears 


completely when instead dimensions 27 and 29 are compared 
as seen in Fig. 4. Many test runs suggest that the z fractions 
exhibit correlation only in successive dimensions and only 
when accessed in their order of occurrence, regardless of 
where the sequence is started. But when a different index 
greater than 1 is used, for example, a value of 2, there is no 
obvious correlation as shown in the (x57, x»s) plot in Fig. 5. 
These data suggest it is reasonable to believe that indeed the z 
fractions provide uniformly distributed uncorrelated sample 
points as long as successive fractions are not used to compute 
the sample point coordinates. 


q Fraction CDF 


@ = 0-215,829) 
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Fig. 1. a fraction Cumulative Distribution Function. 


IV. xGASR ALGORITHM 


The utility of x fractions was investigated by generating 
uniformly distributed sample points and pseudo random 
numbers in the genetic algorithm tGASR which is based on Li 
et al.'s novel GA [9]. A standard GA is improved in [9] by (1) 
allowing competition between child chromosomes in a new 
crossover operator resulting in better interpolation and 
extrapolation of decision space sample points and (ii) 
introducing an iteration-dependent mutation operator. Li et 
al.'s algorithm is referred to here as "Genetic Algorithm with 
Sibling Rivalry" (GASR) because of the new crossover 
operator (see [9] for details and note that the "SR" descriptor 
is introduced here). Its implementation using z fractions is 
algorithm 1GASR. Note that tGASR maximizes the objective 
function instead of minimizing it. 


Of course, being a genetic algorithm, xGASR is 
inherently stochastic. But it can be made deterministic by 
using z fractions to create the initial chromosome distribution 
(population) and in generating pseudo random numbers for 
crossover, mutation, and elitism testing, which is the approach 
taken here. The scheme for selecting the z, distributions, 


which is determined by the algorithm designer, may be found 
in the online xGASR source code [15]. The manner in which 
they were selected avoids the bidimensional correlation issue 
discussed in $Ш. 
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V. BENCHMARK RESULTS 


mGASR was tested in two ways against the six-function 
benchmark suite shown in Table 1. DS is the benchmark 
(objective) function's decision space, x* the location of its 


known maximum, and f(x*) its value. This suite was used in 
[10] to test the new algorithm vibrational-PSO (v-PSO). 


Comparative v-PSO and 1GASR results are reported in Tables 


2 and 3. 
mGASR was implemented with the following parameters: 
crossover probability, 0.8; mutation probability, 0.02; 
crossover weight factor w, 0.5 [9]; mutation shape factor В : 
2 [9]. In Table 2 the numbers of generations and 
chromosomes were 101 and 2500, respectively, whereas in 
Table 3 the corresponding values were 100 and 2000. In both 
cases the best chromosome from the previous generation was 
randomly inserted into the next one ("elitism"). Runs in Table 
1 were terminated early if the change in fitness between the 
current generation and the 20" previous one was < 10°. But in 
order to provide a head-to-head statistical comparison with v- 
PSO, the tGASR runs in Table 3 ran to completion using all 


20,000,000 function evaluations. 


HALTON POINTS IN 30 DIMENSIONS, 1000 POINTS. 


Plot of dimensions 27 and 28. 
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Fig. 2. Coordinates (x27,%23) 30D Halton sequence (1,000 points). 


Table 2 compares v-PSO and a single nGASR run for the 


10/20/30-dimensional benchmarks. Ng and N,,4; are the DS 
of mGASR function 


dimensionality and total number 


well on fs. For fs with Nj=30 tGASR required only 294,763 
evaluations (98.5% fewer than v-PSO) to return a best fitness 
of -9.400238x10? compared to v-PSO's average value of 
-2,139.5x103.3. These results strongly suggest that pseudo 
random fractions can be very useful in implementing what 
amount to deterministic "stochastic" algorithms thereby 
avoiding the need to make multiple runs to generate statistical 


data. 
mGASR also was compared to v-PSO on a statistical basis. 
Table 3 summarizes data using the same number of total 
evaluations for each benchmark (20,000,000) and a different x 
fraction distribution for each tGASR run (details in the online 
source code listings [15]). Table 3 shows tGASR's average 
best fitness and its standard deviation as well as its best fitness 
returned over all runs. Compared to v-PSO pseudo random 
mGASR performed somewhat worse on fz, essentially the same 
on fz and fz; better on fz, slightly worse on fs, and much better 
on fs. Overall the results are very similar to the single run data 
in Table 2. But even in cases where v-PSO outperformed 
mGASR the differences are not dramatic, and as before for 
function f6 tGASR outperforms v-PSO by a very wide margin. 
As would be expected, comparing tGASR data in Tables 2 
and 3 shows that the longer runs with far more function 


evaluations do yield uniformly better results. 
Pi FRACTION POINTS IN 30 DIMENSIONS, 1000 POINTS. 


Plot of dimensions 27 and 28. 


[Pi Fraction index initialized to 1 with index increment of 1] 
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x27 
Fig. 3. Coordinates (x27,x23) 30D a fractions, index increment = 1. 


VI. CONCLUSION 


evaluations, respectively. The v-PSO data are average values 
for 100 runs using 200,000 function evaluations per run 
(20,000,000 evaluations of each test function). Because v- 
PSO performs minimization the signs of its results have been 
changed for comparison to tGASR. In all cases in Table 2 
only one tGASR run was made because every 1GASR run 
with specific pseudo random fraction distributions yields 
precisely the same results. 
mGASR performs much better than v-PSO in terms of 
function evaluations. Its worst case figure of 656,308 is 
nearly 97% less than v-PSO's 20,000,000, a remarkable 
reduction. In terms of solution quality, tGASR performed 
very well on f?. f; and f; ; well on f; and f5 ; and exceptionally 


m fractions have been shown to be an effective approach to 
creating uniformly distributed decision space sample points 
for global search and optimization. Fractions associated with 
constants other than x may be similarly useful, but they have 
not been investigated. Stochastic algorithm 1GASR was used 
as an example, and its performance tested against the v-PSO 
six benchmark suite with generally very good results and in 
one case much better results. л fraction pseudo random 
sequences should be useful for improving the performance of 
any stochastic algorithm in several ways: (i) because the 
resulting sequences are entirely deterministic, all runs with the 
same setup produce exactly the same results thus rendering a 


stochastic algorithm effectively deterministic without 
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compromising its ability to explore the decision space (DS); 
(ii) making successive runs with different sequences likely 
will result in improved performance with far fewer function 
evaluations; (iii) DS adaptation is easily accomplished because 
the sequences are deterministic (for example, shrinking DS 
around a group of maxima); and (iv) making it possible to 
efficiently adjust an algorithm's parameters in real time. m 
fraction sequences should be similarly useful for injecting 
pseudo randomness into purely deterministic algorithms like 
CFO thereby enhancing their ability to explore DS. 


Pi FRACTION POINTS IN 30 DIMENSIONS, 1000 POINTS. 
Plot of dimensions 27 and 29. 


[Pi Fraction index initialized to 1 with index increment of 1] 
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Fig. 4. Coordinates (x27,x29) 30D a fractions, index increment = 1. 
Pi FRACTION POINTS IN 30 DIMENSIONS, 1000 POINTS. 


Plot of dimensions 27 and 28. 


[Pi Fraction index initialized to 1 with index increment of 2] 
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Fig. 5. Coordinates (x27,x23) 30D x fractions, index increment = 2. 
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Table 1. v-PSO Benchmark Functions. 







































































Fnc# Function f(x) DS х* f(x*) 
1 4 
20exp| -0.2,| — 9a? |+ 
Na 7 [-30,30]™ [0]^ 0 
Л Ackley 
1 4 
ехр YE cos(2z x,) |- 20—e 
N, ї=1 
Cosine Na 2 Na [—1,1]*4 [0]^4 0.1N 
Pe жу — i x7 + 0.1) cos(5z x,) à 
Na Na 
f Exponential exp(-0.59 ^ 32) [—1,1] [0] 1 
1 а 
-— (x, 100) ^ 
f Griewank 4000 [-600 ,600 ]" [0] Na 0 
TI" с^ - | i 
i=1 Ji 
Na [—5.12,5.12]*4 oye 0 
fr | Rastrigin | — >) \“[x? -10cos(2x x,) +10] [9] 
% Schwefel | — 418.9829 N; + У [x, sin(,/ |х, )]| [-500,500]"^ | [420.9687] 0 
Table 2. Single Run xGASR Data for v-PSO Benchmark Suite. 
Best Fitness 
сй М, nGASR 
v-PSO* mGASR (single run) Neval 
10 —1.84e-15+2.9e-16 —5.762878е-4 656,308 
Л 20 —2.84е-15+1.5е-16 —1.161337e-2 328,243 
30 —4.93е-15+3.4е-16 —6.988124e-3 457,978 
10 1+0 0.9999997 457,978 
b 20 2+0 1.9999993 457,978 
30 3+0 2.9999981 394,558 
10 1+0 0.9999999 361,090 
fs 20 1+3е-18 0.9999999 294,763 
30 1+1е-17 0.9999999 328,243 
10 —0.020+0.006 —0.004429 492,372 
f 20 —0.0026+0.002 —0.015874 361,090 
30 —8.8568e-4+0.001 —0.002139 457,978 
10 0+0 —1.057361е-4 425,640 
fs 20 0+0 —1.203252e-3 394,558 
30 —5.6843е-16+1е-15 —9.932735е-5 492,372 
10 —620.8131450.4 —7.753379е-4 457,978 
№ 20 —1.3384e+3+68.5 —1.6669'76e-4 394,558 
30 —2.1395e+3+103.3 —9.400238e-3 294,763 























* average best fitness over 20,000,000 evaluations; data reproduced from Table IV 
in [10] with sign changed because tGASR maximizes f(x) while v-PSO minimizes. 
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Table 3. xGASR Statistical Data for v-PSO Benchmark Suite. 
Average Best Fitness 
jnc# Na (100 runs, total of 20x10$ fnc evals each benchmark) nGASR Overall 
Best Fitness** 
v-PSO* nGASR Avg / Std Dev 

10 —1.84e-15+2.9e-16 —3.25606e-3 / 2.90e-3 —7.22411е-5 
Л 20 —2.84е-15+1.5е-16 —3.71691e-3 / 4.04e-3 —1.58685e-4 
30 —4.93е-15+3.4е-16 —3.54867e-3 / 3.03e-3 —1.22941e-4 

10 1+0 0.9999999 / 2.33e-7 0.9999999 

Í 20 2+0 1.9999997 / 3.83e-7 1.9999999 

30 3+0 2.9999995 / 8.41e-7 2.9999999 

10 1+0 0.9999999 / 9.40е-9 0.9999999 

f 20 1+3е-18 0.9999999 / 1.93e-8 0.9999999 

30 1+1е-17 0.9999999 / 3.55e-8 0.9999999 
10 —0.020+0.006 —5.02147e-4 / 7.44e-4 —6.39425е-10 
f 20 —0.0026+0.002 —7.29040е-4 / 1.25е-3 —3.29534e-09 
30 —8.8568е-4+0.001 —8.45741е-4 / 1.354е-3 —6.00263e-07 

10 0+0 —2.53755e-4 / 4.08e-4 —2.73693e-7 
f 20 0+0 —6.25339е-4 / 1.20е-3 —1.40063e-6 
30 —5.6843е-16+1е-15 —6.13252e-4 / 9.69e-4 —1.38614e-7 
10 —620.8131+50.4 —1.84158e-4 / 8.37e-5 —1.27276e-4 
fs 20 —1.3384е+3+68.5 —4.36412е-4 / 3.40е-4 —2.55634е-4 
30 —2.1395е+3<+103.3 —6.58102е-4 / 4.18е-4 —3.82090е-4 




















* average v-PSO best fitness over 20,000,000 evaluations; data reproduced from Table IV 
in [10] with sign changed because tGASR maximizes f(x) while v-PSO minimizes. 
** best TGASR fitness over all 20,000,000 objective function evaluations 
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